climate prediction
Data-driven Seasonal Climate Predictions via Variational Inference and Transformers
Palma, Lluís, Peraza, Alejandro, Civantos, David, Duarte, Amanda, Materia, Stefano, Muñoz, Ángel G., Peña-Izquierdo, Jesús, Romero, Laia, Soret, Albert, Donat, Markus G.
Most operational climate services providers base their seasonal predictions on initialised general circulation models (GCMs) or statistical techniques that fit past observations. GCMs require substantial computational resources, which limits their capacity. In contrast, statistical methods often lack robustness due to short historical records. Recent works propose machine learning methods trained on climate model output, leveraging larger sample sizes and simulated scenarios. Yet, many of these studies focus on prediction tasks that might be restricted in spatial extent or temporal coverage, opening a gap with existing operational predictions. Thus, the present study evaluates the effectiveness of a methodology that combines variational inference with transformer models to predict fields of seasonal anomalies. The predictions cover all four seasons and are initialised one month before the start of each season. The model was trained on climate model output from CMIP6 and tested using ERA5 reanalysis data. We analyse the method's performance in predicting interannual anomalies beyond the climate change-induced trend. We also test the proposed methodology in a regional context with a use case focused on Europe. While climate change trends dominate the skill of temperature predictions, the method presents additional skill over the climatological forecast in regions influenced by known teleconnections. We reach similar conclusions based on the validation of precipitation predictions. Despite underperforming SEAS5 in most tropics, our model offers added value in numerous extratropical inland regions. This work demonstrates the effectiveness of training generative models on climate model output for seasonal predictions, providing skilful predictions beyond the induced climate change trend at time scales and lead times relevant for user applications.
Enforcing Equity in Neural Climate Emulators
Neural network emulators have become an invaluable tool for a wide variety of climate and weather prediction tasks. While showing incredibly promising results, these networks do not have an inherent ability to produce equitable predictions. That is, they are not guaranteed to provide a uniform quality of prediction along any particular class or group of people. This potential for inequitable predictions motivates the need for explicit representations of fairness in these neural networks. To that end, we draw on methods for enforcing analytical physical constraints in neural networks to bias networks towards more equitable predictions. We demonstrate the promise of this methodology using the task of climate model emulation. Specifically, we propose a custom loss function which punishes emulators with unequal quality of predictions across any prespecified regions or category, here defined using human development index (HDI). This loss function weighs a standard loss metric such as mean squared error against another metric which captures inequity along the equity category (HDI), allowing us to adjust the priority of each term before training. Importantly, the loss function does not specify a particular definition of equity to bias the neural network towards, opening the door for custom fairness metrics. Our results show that neural climate emulators trained with our loss function provide more equitable predictions and that the equity metric improves with greater weighting in the loss function. We empirically demonstrate that while there is a tradeoff between accuracy and equity when prioritizing the latter during training, an appropriate selection of the equity priority hyperparameter can minimize loss of performance.
Interpretable Machine Learning for Weather and Climate Prediction: A Survey
Yang, Ruyi, Hu, Jingyu, Li, Zihao, Mu, Jianli, Yu, Tingzhao, Xia, Jiangjiang, Li, Xuhong, Dasgupta, Aritra, Xiong, Haoyi
Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede user trust and hinder further model improvements. As such, interpretable machine learning techniques have become crucial in enhancing the credibility and utility of weather and climate modeling. In this survey, we review current interpretable machine learning approaches applied to meteorological predictions. We categorize methods into two major paradigms: 1) Post-hoc interpretability techniques that explain pre-trained models, such as perturbation-based, game theory based, and gradient-based attribution methods. 2) Designing inherently interpretable models from scratch using architectures like tree ensembles and explainable neural networks. We summarize how each technique provides insights into the predictions, uncovering novel meteorological relationships captured by machine learning. Lastly, we discuss research challenges around achieving deeper mechanistic interpretations aligned with physical principles, developing standardized evaluation benchmarks, integrating interpretability into iterative model development workflows, and providing explainability for large foundation models.
Encoding Seasonal Climate Predictions for Demand Forecasting with Modular Neural Network
Marvaniya, Smit, Singh, Jitendra, Galichet, Nicolas, Otieno, Fred Ochieng, De Mel, Geeth, Weldemariam, Kommy
Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial to improve its resilience. Representing mid to long-term seasonal climate forecasts is challenging as seasonal climate predictions are uncertain, and encoding spatio-temporal relationship of climate forecasts with demand is complex. We propose a novel modeling framework that efficiently encodes seasonal climate predictions to provide robust and reliable time-series forecasting for supply chain functions. The encoding framework enables effective learning of latent representations -- be it uncertain seasonal climate prediction or other time-series data (e.g., buyer patterns) -- via a modular neural network architecture. Our extensive experiments indicate that learning such representations to model seasonal climate forecast results in an error reduction of approximately 13\% to 17\% across multiple real-world data sets compared to existing demand forecasting methods.
Can we rely on machine intelligence to fix our climate?
As more and more industries take on artificial intelligence to solve some of their biggest challenges, can machines help us understand and fix climate change issues? So your phone recognises your face, and your bank can block any transaction unlike your spending habits. And your online supermarket nudges you with their vegan products just because you've bought that oat milk once, while your online movie platform keeps throwing B-movies at you after you watched that soap opera last month. A growing number of our devices and services are relying on artificial intelligence (AI), a technology that continues to branch out and pop up in more and more areas of our lives. Scientists, entrepreneurs, and governments are leveraging AI to explore solutions for some of society's biggest challenges.
Machine learning may be a game-changer for climate prediction
In a paper recently published online in Geophysical Research Letters (May 23), researchers led by Pierre Gentine, associate professor of earth and environmental engineering at Columbia Engineering, demonstrate that machine learning techniques can be used to tackle this issue and better represent clouds in coarse resolution ( 100km) climate models, with the potential to narrow the range of prediction. "This could be a real game-changer for climate prediction," says Gentine, lead author of the paper, and a member of the Earth Institute and the Data Science Institute. "We have large uncertainties in our prediction of the response of the Earth's climate to rising greenhouse gas concentrations. The primary reason is the representation of clouds and how they respond to a change in those gases. Our study shows that machine-learning techniques help us better represent clouds and thus better predict global and regional climate's response to rising greenhouse gas concentrations."
Machine learning may be a game-changer for climate prediction
A major challenge in current climate prediction models is how to accurately represent clouds and their atmospheric heating and moistening. This challenge is behind the wide spread in climate prediction. Yet accurate predictions of global warming in response to increased greenhouse gas concentrations are essential for policy-makers (e.g. the Paris climate agreement). In a paper recently published online in Geophysical Research Letters, researchers led by Pierre Gentine, associate professor of earth and environmental engineering at Columbia Engineering, demonstrate that machine learning techniques can be used to tackle this issue and better represent clouds in coarse resolution ( 100km) climate models, with the potential to narrow the range of prediction. "This could be a real game-changer for climate prediction," says Gentine, lead author of the paper, and a member of the Earth Institute and the Data Science Institute.
Claim: Machine learning may be a game-changer for climate prediction
From the COLUMBIA UNIVERSITY SCHOOL OF ENGINEERING AND APPLIED SCIENCE and the "learn garbage in, get garbage out" department. New York, NY–June 19, 2018–A major challenge in current climate prediction models is how to accurately represent clouds and their atmospheric heating and moistening. This challenge is behind the wide spread in climate prediction. Yet accurate predictions of global warming in response to increased greenhouse gas concentrations are essential for policy-makers (e.g. the Paris climate agreement). In a paper recently published online in Geophysical Research Letters (May 23), researchers led by Pierre Gentine, associate professor of earth and environmental engineering at Columbia Engineering, demonstrate that machine learning techniques can be used to tackle this issue and better represent clouds in coarse resolution ( 100km) climate models, with the potential to narrow the range of prediction.
Machine learning may be a game-changer for climate prediction
New York, NY--June 19, 2018--A major challenge in current climate prediction models is how to accurately represent clouds and their atmospheric heating and moistening. This challenge is behind the wide spread in climate prediction. Yet accurate predictions of global warming in response to increased greenhouse gas concentrations are essential for policy-makers (e.g. the Paris climate agreement). In a paper recently published online in Geophysical Research Letters (May 23), researchers led by Pierre Gentine, associate professor of earth and environmental engineering at Columbia Engineering, demonstrate that machine learning techniques can be used to tackle this issue and better represent clouds in coarse resolution ( 100km) climate models, with the potential to narrow the range of prediction. "This could be a real game-changer for climate prediction," says Gentine, lead author of the paper, and a member of the Earth Institute and the Data Science Institute.
Zooming in on climate predictions
In the quest to better understand climate change, there is plenty we still don't know. But the question isn't whether or not climate change is happening. "What we sometimes hear on the news is political manufactured uncertainty," said Auroop Ganguly, a professor of civil & environmental engineering at Northeastern. Instead, real climate change uncertainty stems from the challenge of simulating the future. What will happen to Boston's electric grid under long-term extreme weather conditions?